Sparse Coding of Time-varying Natural Images
نویسنده
چکیده
We show how the principle of sparse coding may be applied to learn the forms of structure occurring in time-varying natural images. A sequence of images is described as a linear superposition of space-time functions , each of which is convolved with a time-varying coeecient signal. When a sparse, independent representation is sought over the coeecients, the basis functions that emerge are space-time inseparable functions that resemble the motion-selective receptive elds of cortical simple cells. Interestingly, the coeecients form a spike-like representation of moving images, and thus suggest an interpretation of spiking activity in the brain in terms of sparse coding in time.
منابع مشابه
Face Recognition using an Affine Sparse Coding approach
Sparse coding is an unsupervised method which learns a set of over-complete bases to represent data such as image and video. Sparse coding has increasing attraction for image classification applications in recent years. But in the cases where we have some similar images from different classes, such as face recognition applications, different images may be classified into the same class, and hen...
متن کاملLearning sparse, overcomplete representations of time-varying natural images
I show how to adapt an overcomplete dictionary of spacetime functions so as to represent time-varying natural images with maximum sparsity. The basis functions are considered as part of a probabilistic model of image sequences, with a sparse prior imposed over the coefficients. Learning is accomplished by maximizing the log-likelihood of the model, using natural movies as training data. The bas...
متن کاملAn ADMM Solution to the Sparse Coding Problem
For our project, we apply the method of the alternating direction of multipliers and sequential convex optimization to sparse coding of images. The motivation behind sparse coding of images is to model how the brain is able to efficiently utilize the human visual system for a variety of tasks, such as separating a car from a background, as well as general classification tasks. Sparse coding aim...
متن کاملTemporal and Spatial Characters of Retinal Ganglion Cells’ Response to Natural Stimuli
Results from physiological, theoretical, and computational studies suggest that the visual cortex processes natural sensory information with a strategy of sparse coding. To investigate whether this is also the case for retinal ganglion cells (RGCs), neuronal activities were recorded from a group of chicken RGCs in response to natural, time-varying images (movies) using extracellular multielectr...
متن کامل